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ABSTRACT 


The Korean Air Force 1s continuously being challenged with the problem of whether 
to drop or retain a student who 1s having difficulties in flight training. The pass or fail 
decision is critical not only to the Korean Air Force but also to the student pilot himself. 
The purpose of this studv 1s to determine and standardize criteria of excellence in order 
to improve the success of the student pilot screening process. The following two re- 
Search questions are addressed: (1) What are the primary factors that predict aviation 
excellence ? (2) How do these factors apply to student pilot screening in the Korean 
Air Force ? The anticipated benefit of this study is the improvement in the screening 


of undergraduate pilots in the Korean Air Force. 
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I. INTRODUCTION 


A. BACKGROUND 

Selecting high-quality pilots is particularly significant to the Korean Air Force be- 
cause the Korean Air Force 1s inferior in size to the Air Force of communist North 
Korea. In terms of militarv balance 1, the Korean Air Force is outnumbered in both 
manpower and equipment bv the Air Force of communist North Korea. Despite 
Korean Air Force efforts to fill the gap, the air power ratio has remained at a constant 
Herel. AS a result of this imbalance, the Korean Air Force must offset numerical infe- 
niority with technology and high-quality pilots. 

As long as the Korean Air Force uses a predictor with a less than perfect validity 
(r= 1.00) for screening student pilots. some errors will occur [Ref. 1: P. 202]. Making 
false selections (e.g., some pilots who are selected should not be selected) is highly un- 
desirable because of the cost of training 2, reduced efficiency, a decrease in air combat 
readiness and so forth. In addition, aircraft accidents due to pilot error stress the 1m- 
Pertance of pilot selection even more. 

In the current Korean Air Force pilot selection system, the instructor performs se- 
veral roles for his students. These roles include the “father image.” the counselor, and 
iemteacher. 10 some degree. he is also a psychologist. He is the first one to say. “Mv 
Seient Can fl or cannot fly. Of course, there is a whole process that involves “washing 
out” a pilot candidate, but the instructor pilot has to make the decision if an individual 
has flving skills that are Worth pursuing or if it’s in everybody's best interest for him to 
do something else for a living. 

Usually, instructors make this decision using standards derived from their own val- 
ues, personality, or previous experience. Also, the relative importance placed on the 
Various Criteria tends to vary from one instructor to another. Therefore, such decisions 
cannot guarantee that a specific student will be successful at any given time. These un- 
standardized criteria among instructors are the major reason for Jow predictor validity 


and false selection in the Korean Air Force. 


1 Defense Foreign Affairs Handbook 1987-1988. 


2 The cost of U.S. Air Force undergraduate pilot training 1s $368,941]. This represents the 
average cost per graduate in a sample training program and reflects initial or entry-level traumng only 
fiver. 2: p. 66). 


To reduce the number of selection mistakes, the Korean Air Force should increase 
the vahdity of the predictor. The greater the validity of the predictor, the smaller the 
chance of false decision-making in undergraduate pilot screening. (Fig. 1) [Ref. 1: pp. 
204-205}. 









< Low Validity > < High Validity > 
Criterion! Criterion 
ecOres| scores 
Criterion} & Criterion 
cutoff cutoff 
5 Predictor cutoff 7 Predictor cutoff 


Predictor scores Predictor scores 


|; orn True Decision Uy False Decision 


Figure 1. Decision Nlaking in Pilot Selection 
Source: Adapted from Muchinsky, Paul M., “Psychology Apphed to Work,” p. 204, 


The Dorsey 1) tess, 1957. 


Bet PURPOSE-OF Tibe Siti 
The purpose of this study is to determine and standardize criteria of excellence in 
order to improve the success of the student pilot screening process. This study will at- 
tempt to idenufy the qualities that characterize excellence in pilot performance and at- 
tempt to relate these qualities to actual flight performance. The questions that will be 
addressed are: 
e What are the primary factors that predict aviation excellence ? and 


e |low do these factors apply to student pilot screening in the Korean Air Force ? 


The Korean Air Force is continuously being challenged with the problem of whether 


to drop or retain a student who is having difficulties in flight training. The pass or fail 


decision is critical not only to the Korean Air Force but also to the candidate pilot 
himself. Thus, the Korean Air Force needs a reliable predictor that can be used to select 


candidates for flight training program who have a high probability of success. 


oy SCOPE 

The data used in this study are taken from the “record of training” of the under- 
graduate pilot training program. This data base contains flight performance grades, ac- 
ademic grades, and quality rating points. A sample of 175 officers was selected from the 
population of Korean Air Force Academy cadets and ROTC officers. The statistical 
analysis system (SAS) procedures were used to analyze and process that data set. The 
intent of this study is to analvze the human characteristics of a general pilot and not 


focus extensively on a combat-eflective pilot. 


D. ORGANIZATION OF THE STUDY 

The next chapter. “Background and Literature Review,” discusses different method- 
ologies, data sets used, and the findings of various studies. Chapter III, “Excellent Pilot 
Model.” develops an empirical model (based on regression analysis) that incorporates 
fevers allecting excellence in aviation in the Korean Air Force. Chapter IV, “Empirical 
Estimation.” presents and discusses the results of this model. Chapter 1V also interprets 
the meaning of the estimated coefficients and discusses the “goodness-of-fit” of the 
model. The final chapter. “Conclusions and Recommendations.” presents the overall 
findings of the study regarding the relationships between performance in flving and stu- 


dent pilot qualities and makes recommendations for further study of these relationships. 


Il. BACKGROUND AND LITERATURE REVIEW 


A. KOREAN AIR FORCE PILOT SELECTION 

The Republic of Korea Air Force (ROKAF) consists of three commands under the 
Air Force Chief of Staff: the Tactical Air Command, the Education and Training Com- 
mand, and the Logistics Command. Pilot selection and training are conducted by the 
Education and Training Command. The Korean Air Force pilot training program con- 
sists of three stages. These are the Primary Pilot Training program, the Intermediate 
Pilot Training program, and the Advanced Pilot Training program. 

The Korean Air Force Academy (KAFA) and ROTC are the major sources of pilot 
candidates for the Air Force. The Primary Pilot Training program is a required course 
for physically qualified first class (senior vear) cadets and ROTC officers who volunteer 
to attend the pilot training programs. This program is conducted at the Air Force 
Academy airfield. Air Force pilots and retired pilots are instructors. Instruction in- 
cludes ground training classes in airmanship. safety, and aircraft svstem. as Well as a 
flving phase. Pilot candidates must successfully complete this program in order to enter 
the follow-on Intermediate Pilot Training program. 

The Korean Air Force is using an actual in-flight selection system. In this svstem. 
all Korean Air Force Acadenw graduates and ROTC officers who pass the medical ex- 
amination can enter a Primary Pilot Training program and have a chance to flv. The 
only admission requirement is a medical clearance. After a certain amount of flying. 
candidates are evaluated on their flving ability through an initial aptitude checkride. The 
goal of this checkride is to identifv¥ those student pilots who have the basic aptitude to 
become Air Force pilots. The checkrides of the undergraduate pilot training course are 
conducted by check instructors who are experienced pilots. Thev evaluate the student's 
performance on each maneuver. The evaluator must consider several factors in addition 
to the student’s compliance with maneuver parameters. These factors include demon- 
strated proficiency, judgment, air sense, and overall ability to safely and confidently 
maneuver the aircraft. 

The Korean Air Force training command uses a multiple “hurdle” selection strategy. 
In this multiple hurdle system, candidates must get satisfactory scores on a number of 


flight performance measures. The successful candidate is one who passes each hurdle 


and gets his wings. First, candidates who meet basic requirements are chosen to com- 
prise a pool of student pilots. To become an Air Force pilot, the initial aptitude 
checkride is the most important hurdle to the student pilots. At various points, addi- 
tional hurdles (e.g., solo checkride, final checkride) are presented. Eventually, a certain 
number pass all the hurdles, and these student pilots become fighter pilots, helicopter 
pilots, and propeller pilots. To survive in the program, student pilots must pass each 


hurdle. Figure 2 shows the Korean Air Force Pilot Training Program. [Ref. 1 : p. 217] 


PRIMARY PILOT TRAINING 


INTERMEDIATE PILOT TRAINING 
ADVANCED PILOT TRAINING 


KOREAN AIR FORCE PILOT 





Figure 2. The Korean Air Force Pilot Training Program 
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B. PREVIOUS STUDIES CONCERNING PILOT SELECTION 

From the beginning of aircraft development there have been constant efforts to se- 
lect individuals who possess both physical and mental attributes conducive to success in 
flight training [Ref. 3: p. 1]. Pilot candidate selection is the process of choosing a subset 
of applicants for flight training. Selection implies that some applicants will get accepted 
While others will not. It 1s important to understand on what basis applicants are selected 
for flight training. Selected applicants are predicted to have a higher probability of 
success than rejected applicants. The basis for this prediction may be a selection test 
score, the results of an interview, or some other measure. {Rei 12 pp. [o0=lo ue) 

Over time, the pilot selection process has varied considerably. Early wartime se- 
lection was determined simplv on the basis of medical fitness [Ref. 4: p. 50]. But it was 
noted during WW JI that a significant number of aircraft accidents were not due pri- 
marily to aircraft failures but to human error. Thus, based on these data. several elitgmrs 
Were initiated to predict pilot training success [Ref. 3: p. 3]. Since the advent of WW 
II]. a large number of studies have been conducted with the goal of identifving factors 
unportant in the prediction of success in military pilot training. 

The purpose of reviewing previous pilot selection studies 1s to develop a conceptual 
framework for the study. This literature review examines the different methodologies 
and predictor variables employed in various studies and the relevance of previous 


findings to the present research. 


1. Korean Air Force Studies 

There are a few studies concerning Korean Air Force pilot selection. One study 
was performed bv Major Lee. a Korean Air Force pilot, in 1986 [Ref. 5]. The purpose 
of his study was to provide a step toward increasing air combat effectiveness of the 
Korean Air Force, and further promote the Korean Air Force research activities. By 
researching previous studies, he found the determinants of a combat-effective pilot: the 
combat skills and psychological characteristics that have a positive relationship with 
combat effectiveness. He surveved 12 Korean Air Force pilots at the Naval Postgrad- 
uate School. They had more than 1000 hours of fighter flying time each and more than 
5 vears in a tactical fighter squaron, which was considered enough experience to make 
them credible respondents. He asked their opinion of the importance of 12 personal 


characteristics significant to the combat-effective pilot. These characteristics are: 


e Aggressiveness 

e Determination 

e Desire to achieve 

e Initiative 

e Courage 

e Willingness to take risk 

e Psychological stress tolerance 
e Physiological stress tolerance 
e Anxiety tolerance 

e Team coorperativeness 

e Endurance 


e Leadership 


Approximately $5 percent of the pilots rated desire to achieve, aggressiveness, and deter- 
mination as being critical or verv important personal characteristics. The characteristics 
courage, initiative, and willingness to take risk Were rated critical or very important by 
approximately 70-75 percent of the pilots. [Ref. 5: P. 40] 

The results of Major Lee’s survey provided valuable information for the future 
policy of pilot management in the Korean Air Force. For example, the average weighted 
ratings of the Korean Air Force pilots’ psychological characteristics highlight a lack of 
aggressiveness and willingness to take risk. He thought that these personalitv weaknesses 
nught be due to the Korean Air Force basic flving philosophy: “Safetv is paramount”. 
Finally, he concluded that the Korean Air Force should focus on analvzing pilot data 
to select more substanual combat-effective pilots and manage them scientifically for in- 
creased air combat readiness. [Ref. 5: pp. 47-49] 

Another study was performed bv Captain Park [Ref. 6], who is also a Korean 
Air Force fighter pilot concerned about the Korean Air Force pilot selection. The pur- 
pose of his study was to suggest pilot selection methods that provide potential success 
in flight training and improve pilot quality. First, he pointed out the problem in the 
Korean Air Force pilot selection system. The problem is the Korean Air Force cannot 
adequately take into account a candidate’s mental ability due to its poor selection device. 
He also introduced three aviation selection test batteries currently being used by the U.S. 
Emmet oree and U.S. Navy. 


Finally, he recommended that the Korean Air Force use psychological tests or 
test batteries to improve the prediction outcome of the Korean Air Force pilot candidate 
selection system. He especially emphasized the psychomotor test because some of the 
psychomotor scores are significantly different between candidates who complete pilot 


training program and those who do not. [Ref. 6: p. 50] 


2. U.S. Studies 
In 1967, James R. Berkshire [Ref. 7] conducted a studv to determine whether 
any of several experimental tests might add significantly to the validity of the test battery 
that was being used to predict student pilot success in flight training. At that time, the 
selection test battery included a general intelligence test, the Mechanical Comprehension 
Test (MCT). and the Spatial Apperception Test (SAT). But it was folind that ey enem 
the highest selection test group. about I5 percent of the selectees failed to complete the 
training program. It indicated that an examination of the causes of their failure might 
reveal areas of flving ability not covered by the selection tests. He used the following 
experimental tests 1n his study: 
e Altitude Judgment Test. 
e Naneuvers Test. 
e Instrument Comprehension Test. and 


* Bacxeround Test?) (Rel. 7 ps Z| 


These experimental tests were administered to aviation students during their first 
week of flight training. Two vears later the data were divided into the scores of those 
who completed and those who did not. He used the Wherry-Doolittle procedure to 
identify the best combination of variables with which to predict attrition and their ap- 
propriate weights. Based on the results of his study, Berkshire offered the following 


conclusions: 


e The instrument Comprehension Test should be validated with the present selection 
batten, 


¢ The valid items from the Background Test should be incorporated into the Bi- 
ographical Inventory and revalidated under selection conditions [Ref. 7: p. 7]. 


3 Twenty item scale used to estimate the cultural (or socioeconomic) level of the respondent’s 
home at the time the aviation student was in high school. 


One interesting finding of his study was that the Altutude Judgement Test did 
not contribute to any prediction formula. Berkshire concluded that it probably inter- 
correlated with the Mechanical Comprehension Test and the Instrument Comprehension 
Test [Ref. 7: pp. 2-3]. Berkshire’s study suggests two important predictor variables that 
can improve predictive validity. The first 1s instrument comprehension ability, which 1s 
one of the flying aptitude variables. Instrument comprehension ability is fundamental 
to pilots because flving itself requires monitoring many instruments. 

The other important predictor variable 1s biographical information of the pilot 
candidate. Of all the predictors used to forecast performance, biographical information 
has consistently shown the greatest validity. Muchinskv [Ref. 1] answered the question 


“why is biographical information so valid ?” with the following reasons: 


e <A detailed biographical form samples a large domain of activities and interests in 
a person’s life. 


¢ Biographical information 1s Very reliable. Since validity is limited by reliability. the 
high reliability of biographical information does not put anv ceiling on its potential 
mamait. |Ref. 1}: p. 157). 


There is frequently a fair degree of consistency in people's lives; the individual who 
played with mechanical tovs as a child often retains interest in manipulating mechanical 
objects as an adult. The psychological axiom that “the best predictor of future behavior 
is past behavior of a similar kind” is perhaps the core of the validity of biographical in- 
formation. Accordingly, the instrument comprehension ability factor and biographical 
factor of a pilot candidate should be included in developing the theoretical excellent: pilot 
model. 

In 1967, another studv of predicting success in flight training was performed by 
Flovd E. Peterson, Richard F. Booth, Norman E. Lane, and Rasalie K. Ambler [Ref.- 
8]. Since 1963, the Aviation Psychology Division of the Naval Aerospace Medical In- 
stitute has provided information to Naval aviation training administrators confronted 
with decisions of whether to drop or retain a student who is having difficulties in flight 
training. Upon request, administrators were given the computed probability of a specific 
student successfully completing the flight training program. These probabilities were 
obtained by appropriately weighting valid past performance measures such as initial se- 
lection test scores, academic course grades, and flight training grades. They attempted 


to develop a system for the prediction of student success or failure in Naval Flight Of- 


ficer Training and thus assist the training administrators in their decisions (e.g., which 
student in academic difficulty should be given additional instructional time and which 
should be considered unworthy of additional instruction). 

Thev used the “training record” as basic data for their study. The one strong 
point of their study is that they excluded the students who dropped for reasons of med- 
ical disqualification, personal hardship, and disciplinary action. In order to identify the 
relationship between academic grades and flight training success, thev used the initial 
Selection test scores and the grades received during the flight preparation portion of the 


academuc courses as predictor variables. The breakdown of these tests is as follows: 


e Initial Selection Tests 
» Aviation Qualification Test (AQT) 
e Mechanical Comprehension Test (MCT) 
» Spatial Apperception Test (SAT) 
= Biographical Inventory (BI) 
e Pre-Flight Tests 
» Aerodynamics 
» Navigation 
» Physiology 
» Physical Training 


s. (reer Rating [Reins pa) 


Thev also used the Wherrv-Doolittle method to determine which variables in 
combination would vield the highest multiple correlation with the criterion. When all 
variables were used. four variables were selected as significant predictors. Thus. the 
weights to be applied to the first four variables chosen were computed. By appropriately 
weighting each of four variables selected, predictor scores were computed for all students 
included in their analysis sample [Ref. 8 : pp. 1-3]. The variables chosen and the multiple 


R’s are shown in Table 1. 


Table 1. VARIABLES SELECTED FOR PREDICTOR SCORE FORMULA 


Variables Selected Cum.NMfultiple R 


Navigation 


Mechanical Comprehension Test 
Aviation Qualification Test 
imewer Plants 





pemece: Peterson. Floyd E. et al., Prediction Success in Naval Flight Officer Training.” 
pao, NA ViI-966, February 1967. 


An encouraging result of the study by Peterson et al. is the face validity of the 
four variables chosen. The variable receiving the largest weight is the navigation grade. 
It is logical that scores received in a navigation course are predictive of future perform- 
ance in a flight training program which will be heavily loaded with instruction in navi- 
gation flight training. This result suggests that pre-flight academic performance has a 
predictive validity for student pilot success in flight training. 

The Korean Air Force does not use any initial selection tests such as the Me- 
chanical Comprehension Test and the Spatial Apperception Test. However, the pre- 
flight training program includes Aerodynamics, Navigation, Aircraft Svstem and so 
forth. Therefore, pre-flight academic performance scores would be available for use in 
an excellent pilot: model for the Korean Air Force. 

Because of the extensive cost of pilot training, there is a constant effort to select 
individuals who have the greatest probability of successfully completing the pilot train- 
ing program. Therefore, investigations of the predictive validity of new or untried in- 
struments are frequent. Unlike the other pilot selection tests, which require objective 
answers, in personality inventories the individual's responses are neither right nor wrong. 
Test takers answer questions about their personal likes ( “I like to go swimming”) or how 
much they agree with certain statements (“People who work hard get ahead”). The basic 
rationale behind this test is that successful pilots have certain interests or personality 
pamterns PRef. 1: p. 142]. 

Thus, much research has been devoted to investigating paper-and-pencil and 
projective personality inventories to determine their usefulness in predicting motivational 


categories of attrition in pilot training programs. In this vein. in 1966, Howard L. 


I] 


Fleischman, Rosalie K. Amber, and Floyd E. Peterson [Ref. 9] examined the relation- 
ship of five personality scales to success in naval aviation training. The five scales are 


as follows: 
e Cattell’s Sixteen Personalitv Factor Questionnaire (Table 2), 
e the Taylor Manifest Anxiety Scale, 
e the Alternate Manifest Anxiety Scale, 
e the Pensacola Z Scale, and 


® the Adjective Check-Lict 


Table 2. SIXTEEN PERSONALITY FACTORS 


Factor A Warm. Sociable Aloof, Suff 

Factor B General Intelligence Mental Defect 

Pacton Mature, Calm Immature. Unstable 
Pactor E Aggressive, Competitive NMailk-Toast. Mild 
Factor F Enthusiastic Glum, Sober, Serious 
Factor G Conscientious, Persistent Casual, Undependable 
Factor HI Adventurous Shiva mid 

Factor | Sensitive Tough. Realistic 


Factor L Suspecting, Jealous Accepting, Adaptable 


Factor M Unconventional Practical 

Factor Sophisticated. Polished Simple. Unpretentious 

Factor O Tinud, Insecure Confident. Self-Secure 

Factor Ol Radicalist Conservatism of Temperament 
Factor Q2 Self-Sufficient Sociably Group Dependent 
PacionO5 Controlled Uncontrolled, Lax 

Factor Q4 Tense. Excitableous Phlegmatic, Composed 





Source: Fleischman, Haward L. et al.. “The Relationship of Five Personality Scales in 
Naval Aviation Training,” p. 1, NAMI, May 1966. 


They administered the five personality scales to approximately 700 Navy and 
Marine aviation cadets in 1964 during their first week of training at the U.S. Naval 
School, Pre-Flight. In addition to the twenty personality variables included in the five 
scales, they included the initial selection variables and pre-flight variables in their anal- 


vsis. These variables are: 


e Initial Selection Variables: Biographical Inventory (BI), Aviation Qualification 
Test (AQT), Mechanical Comprehension Test (M{CT). and Spatial Apperception 
Test (SAT). 


e Pre-Flight Variables: Principles of Flight, Navigation, Engines. Physical Training. 
and Peer Rating. 


Intercorrelation matrices consisting of the initial selection variables, pre-flight variables, 
personality variables, and three dichotomous criteria were computed. In particular, thev 


differentiated three types of flight failure: 


e Pass'Fail (composed of successful student aviators and flight failures). 
e Pass Drop (composed of successful student aviators and voluntary withdrawals). 


e Pass Attrite (composed of successful student aviators and attritions for any reason 
other than medical). 


lsereeach Of the three criterion groups, the Wherrv-Doolittle method of multiple re- 
gression was used to determine the extent to which scores on the personality scales 
contributed to the predictive validity of the prediction system. Prediction formulae were 
computed both with the personality scales included and excluded, and the significance 
Siamereases in multiple correlations were determined by F-tests. [Ref. 9: p. 3]. 

The extent to which the inclusion of personality scales increased prediction of 
the three dichotomous criteria is shown in Table 3. The largest increase in multiple R 
was for the Pass and Drop criterion. All increases, however, were significant bevond the 
Ol level. Results indicate that the addition of certain personality measures to the mul- 
tiple prediction formula increase the predictive validity for the three dichotomous criteria 


of success and failure. [Ref. 9 : pp. 2-5]. 


Table 3. MULTIPLE POINT-BISERIAL CORRELATIONS 


Personality Scales Excluded 
Personality Scales Included 





Source: Fleischman, Haward L. et al., “The Relationship of Five PersonalityScales to 
Success in Naval Aviation Training,” p. 5. NAMI, May 1966. 
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The studv bv Fleischman et al. concluded that certain personality variables 
contribute significantly to the multiple prediction of dichotomous criteria of success and 
faiture. The correlation of the personality scales with the criteria is low in this study. 
The correlation between the personality scales and the initial selection tests and pre- 
flight variables is also relatively low. Thus, when considered in conjunction with these 
predictors, the criterion variance explained by the personality measures is largely inde- 
pendent of the variance explained by the other predictor variables. In the Korean Air 
Force training program, certain personahty traits that indicate a good pilot are empha- 
sized by instructors. Therefore, personality factors will be included in developing the 
theoretical excellent pilot mode} for the Korean Air Force. 

Another interesting and useful study was performed by Waag, Wavne L., 
Shannon, Richard H., and Ambler, Rosahe K. [Ref. 10] in 1973. Previous investigations 
had reported significant relationships between confidential instructor ratings 1n the early 
primary phase and later success in Naval flight training. Such ratings were found to 
increase significantly the validities derived solely from selection test scores. Hlowevem 
such findings do not guarantee that confidential rating would augment the variables that 
were being used student pilot prediction system. Thus, the purpose of their investigation 
was to determine if, in fact, the use of instructor ratings would increase significantly the 
validity of the present student pilot prediction svstem [Ref. 10: p. I}. 

Surprisingly, they used instructor rating as a predictor variable in their study. 
Confidential instructor ratings of student pilot performance Were obtained for a sample 
of 1.276 student aviators completing primarv flight training between July 1969 and De- 
cember 1970. Specifically. instructors were asked after the seventh or eighth flight to 


rate their students on each of four questions concerning: 


e The probability of the student obtaining his wings, 
e The student's motivation, 
e The student's headwork4, and 


e The student’s reaction to stress. [Ref. 10: p. 2] 


Table 4 presents the results of analysis for the Aviation Officer Candidates 


(AOC) sample. As indicated, 5.7 percent of the criterion variance could be explained 


4 Headwork is the ability to understand and grasp the meaning of instructions, demonstrations, 
and explanations. 
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by information available prior to primary flight training. The addition of the instructor 
rating on item | (the probability of the student obtaining his wings) increased the ex- 
plained variance by 4.6 percentage points, a fairly substantial amount. Finally. upon 
entering the Pre-Solo grade, an additional 3.3 percent of the criterion variance was ex- 


plained. The final equation yielded a multiple R of .369. [Ref. 10: p. 6] 


Table 4. SUMMARY OF REGRESSION ANALYSIS FOR AOC SAMPLE 


F-Ratio 
For Inclu- 
sion 


Multip| J I 
Variables Entered Multiple R mae: ae Ge 
R-square R-square 
Engineering 0.027 
Officer-Like Qualities 0.014 


Physics Exemption 0.009 
Aerodynamics 0.005 
Mechanical 

Comprehension Test Os 0.002 
Item |-Wings eal 0.046 
Pre-Solo Grade o 0.033 





Source: Waag. Wayne L. et al.. “The Use of Confidential Instructor Rating for the 
Prediction of Success in Undergraduate Pilot Training.” p. 6, NAMI, February 1967. 


The results of this investigation clearly indicate that confidential ratings ob- 
tained from primary flight instructors can provide valuable information related to a 
student's likelihood of receiving his wings. More importantly. such ratings significantly 
increased the predictive validities derived from information that was being used in the 
Student Pilot Prediction Svstem. This suggests that the instructor’s confidential evalu- 
ation may provide additional:information bevond that reflected in the grades he assigned 
[Ref. 10: p. 7]. Waag et al. gave the following reasons to support their reconmmendation 
that such ratings be considered for implementation: 

e The results do replicate the previous finding that: 


= instructor ratings are significantly related to success in naval air training, and 


= instructor ratings significantly increase the predictive validities derived solelv 
from the selection test scores. 


e The results are based upon a relatively large sample size [Ref. 10: p. 8]. 


—" 
tsa 


The flight instructor serves a dual function. Although his principal duty is to 
teach students to flv, he must also evaluate their progress for the record. In the Korean 
Air Force pilot training program, a particular student is assigned to a single instructor. 
Consequently, the instructor 1s able to observe the student's initial reactions to flight as 
well as the progress he makes. An instructor evaluates the student’s characteristic per- 
formance on each maneuver attempted during each dual sorties or observed during a 
solo mission. Each student pilot’s flight performance is converted into a quantitative 
score expressed as a percentage. In each maneuver area, a certain number of points 1s 


awarded for grades in the following categories: 


U Unable to Accomplish 
p Fair 

Good 
a Excellent 


The point values for each grade vary based on the relative weight of the ma- 
neuver area. The overall percentage 1s computed bv adding up all the maneuver area 
point values awarded and dividing the sum bv the maximum possible points. However. 
it is possible that an instructor’s actual opinion regarding a student's progress mav not 


be completely reflected in the grades he assigns. Consequently. the utilization of a con- 


fidential instructor opinion may add significantly to the information available from as- 


signed grades. In other words, the flight instructor’s perspective should be an excellent 


vantage point for evaluating the potential success of his student. [Ref. 11: pp. 5-7] 

In 1977. a study performed by Robert A. North and Glenn R. Gniffin provided 
a wide-range description of tri-service aviator selection testing methods and assessed 
their predictive improvement. In addition, the study suggested methods to improve the 
prediction of aviator success based upon results and findings in their research literature. 


(Ref. 3: p. 1] They summanized their findings as follows: 


The potential for increased success in predicting aviator performance 1s high. The 
fact that current selection tests normally account for less than half of the total var- 
lance associated with aviator success (in training) suggests that there are additional 
factors associated with aviator performance which are not now being adequately 
assessed. The lack of any prominent breakthrough in perceptual and cognitive 
paper-and-pencil testing since war vears (WW-II) suggests that non-paper-and- 
pencil performance tests should be investigated more fully to determine their re- 
lationship to aviator performance in both a training and operational setting [Ref. 3 


op. UE 
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C. SUMMARY 

In chapter I, it was pointed out that the Korean Air Force has low predictor validity 
in pilot selection derived from unstandardized criteria. Student pilots’ psychological 
factors are measured by instructors based on subjective evaluation. This unstandardized 
approach results in false selections and false rejections in pilot screening. Thus, the 
measuring of psychological factors is a major issue of the Korean Air Force pilot train- 
ing command. In essence, the Korean Air Force must find a more effective way to 
evaluate a student's psychological factors. 

In this chapter, the Korean Air Force and U.S. pilot selection studies were discussed. 
These studies suggest the methodologies and predictors available to create an excellent 
pilot model for the Korean Air Force. The suggested predictors are flying aptitude fac- 
tors, biographical factors, personality factors, and the motivation of the pilot candidate. 
The study of confidential instructor ratings performed by Waag et al. suggests that the 
implementation of instructor ratings mav significantly enhance the validity of the pre- 
diction system for the Korean Air Force. The following chapter analvzes Korean Air 
Force student pilot qualities and specifies the excellent pilot model, which mav work to 


improve predictor validity and minimize false selections in the Korean Air Force. 


Li 


Il. EXCELLENT PILOMMOGDEE 


This chapter specifies the excellent pilot’ model incorporating factors that affect 
aviation excellence in the Korean Air Force. The first part of this chapter describes the 
theoretical basis for the excellent pilot model. The criterion and possible predictors for 
an excellent pilot are also discussed in this part. In the next part of the chapter, the 
empirical excellent pilot model (based on the theoretical model) is specified. The method 
used 1s multiple regression analvsis. The “training record” of the sample students 1s used 
as a data base in this model. The “training record” includes a lot of information impor- 
tant for the prediction of pilot training success. The data values are formatted so the 
computer can read them and the statistical analvsis system: (SAS) procedures are used 


to analvze and process that data set. 


A. MODEL THEORETICAL SPECIFICATION 
I. Excellent Pilot Criteria 

Establishing the excellent pilot criteria 1s the first step in evaluating student pi- 
lots. Each time we evaluate someone or something, we use criteria. 

Criteria {the plural of criterion) are best defined as evaluation standards: thev are 
used as reference points in making judgments. We may not be consciously aware 
of the criteria that affect our judgments, but they do exist. We use different criteria 
to evaluate different kinds of objects or people: that is. we use different standards 
to determine what makes a good (bad) movie, dinner, ball game. friend, spouse, or 
teqener | Rely 2290), 

In the pilot selection process, criteria are most important for defining the 
“goodness” of a candidate pilot. What should the criteria be lke? According to 
Muchinsky, criteria must be appropriate, stable, and practical. They should be relevant 
and representative of the job. They must endure over time or across situations. Finally, 
they should not be too expensive or hard to measure. (Relea 

Usually. criteria are classified into two categories on the basis of whether thev 
are Objective or subjective measures. Objective criteria are taken from flight perform- 
ance scores, awards, flving times and so on and supposedly do not involve anv type of 
subjective evaluation. Subjective criteria, on the other hand. are taken from a subjective 
evaluation ofa person’s performance. The judgment is usually a rating or ranking. [Ref. 
1: pp. 99-106] 
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Normally, the pilot training class rank order is used as an aggregate criterion 
of an excellent pilot in the Korean Air Force. The class rank order, however, does not 
completely represent the level of aviation excellence because the instructors rank student 
pilots from high to low on a given performance dimension. The pilot ranked first is re- 
garded as the “best” and the pilot ranked last as the “worst.” However, because rank 
order data have only ordinal scale property, we do not know how good the “best” is or 
how bad the “worst” is. [Ref. 1: p. 314] 

Although analvsis of excellent pilot criteria has in the past been limited to spe- 
cific environments and flving communities, this study will propose a general basis for 
assessment or identification of the individual characteristics and critical skills that are 
thought to characterize an excellent pilot. The total flight performance score will be used 
as an excellent pilot criterion. This total flight performance score is one of the objective 


criteria and reflects a student pilot’s flying skill and psychological factors. 


2. Predictors for an Excellent Pilot 

A predictor is any variable used to forecast a criterion. In weather prediction, 
barometric pressure can be used to forecast rainfall. In medical prediction. body tem- 
perature mav be used to predict illness. In pilot selection, we seek predictor of flight 
training success criterion indexed by flight performance. The predictor variables related 
to excellent pilot criteria are likely to be performance measures on tests of various kinds 
( e.g., flving aptitude, personality, decision making, reaction to stress. motor skills ). If 
a correlation exists between these predictors and excellent pilot criteria, it will be possible 
to identify the best potential excellent pilot through assessing the relevant factors. 
However, it is not easy in reality to assess all relevant predictors because of onlv partial 
relations of factors to criteria. This section will review traditionally-used predictors, ex- 
amine their success, and discuss their application potential in creating the excellent pilot 

model. 

a. Aptitude Factors 

Aptitudes have been successfully used as objective measures to predict flight 
training success. For example, during World War II, the U.S. Armv Air Force Psv- 
chology Program was established to develop a full-scale program for selecting aircrew 
personnel. Under this program, two testing instruments, largely consisting of aptitude 
material, were developed. One of these was the Army Air Force Qualifving Examination 
(AAFQE) which was used as a preliminary screening device. This exam included tests 


for comprehension and judgment, mathematical ability. mechanical comprehension. and 
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observational judgment. [Ref. 12: p. 3-48] Consequently, a large portion of candidates 
who would have failed in training or would have required extra training were undoubt- 
edlv identified before acceptance into training programs. resulting in the savings of 
considerable materiel and instructor time. [Ref. 5 : pp.10] The success of the Army Air 


Force testing program 1s summarized as follows: 


For every 100 graduates from advanced pilot training desired in the summer of 1953, 
it Was necessary to start 397 men in pilot preflight school. When the men were se- 
lected by both the Armv Air Force Qualifving Exanunation and Aircrew Classifica- 
tion Battery (using a stanine score of 7) only 155 men were required to obtain 100 
Graduates: [iereo. oro) 


In addition to the Army Air Force’s effort, several other tests with aptitude 
components have been developed. Fairly high correlations have been reported for the 
Flight Aptitude Rating (FAR) which 1s based upon scores for mechanical and spatial 
abilities. [Ref. 12: p. 3-48] Scores from the FAR test are expressed in stanine scores5. 
In an unrestricted sample these scores usually have a correlation of .40 to .50 (biserial) 
with a criterion based on whether a student pilot completed or dropped from the pro- 
gram. Figure 3 shows the relationship of the FAR scores to success in flight training. 
Nei ae i 

Undoubtedly, the success of FAR ratings and of the Army Air Force testing 
program strongly support aptitude testing for selecting pilots. Because of the broad- 
based scientific support for aptitude testing. 1t seems imperative that it be included in 
developing the theoretical excellent pilot model. However, such aptitude testing does not 
exist in the Korean Air Force. The flying aptitude of the pilot candidate can onlv be 
measured bv the flight instructor. Therefore, the instructors’ aptitude rating 1s recom- 
mended for use as an aptitude variable instead of aptitude testing. 

b. Biographical Factors 
“The best predictor of future behavior is past behavior of a similar kind.” 

For the pilot selection purpose, several instruments have been devised to 
secure biographical information to predict success in training. Manv test batteries also 
contain biographical components. Biographical factors tend to be of three basic types: 
life inventory, academic history, and military history. Sometimes, life inventory factors 


are confused with pilot personality factors. The characteristic tested at the actual time 


5 Stanines are normalized scores with a mean of five, a standard deviation of approximately 
two and a range of | to 9. The word stanine became associated with aircraft specialty tests, but 
has subsequently been used generally. 
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Figure 3. — Relationship of FAR Scores to Success in Flight Training 
Source: Bershire, James R., “Evaluation of Experimental Aviation Selection Tests,” p. 
l, NAMI, March 1967. 


of pilot selection would be categorized as a personality factor; but earlier or historical 
manifestations of that characteristic noted at the time of selection would be treated as 
biographical factors. Because of this possible confusion, the life inventory will not be 
treated as a biographical factor in this theoretical mode] specification. 

Academic grades constitute one biographical variable that has been found 
valuable for predicting success in training. Several studies have found significant re- 
lationships between pre-flight grades and training criteria. For example, as mentioned 
in the literature review, Peterson et al. [Ref. 9] reported statistically significant corre- 
lations between pre-flight academic performance and pass-fail criterion. 

A second important predictor in biographical information is the procure- 
ment source, which also appears to be a valuable predictor of success in training. For 
example, Waag et al. [Ref. 10] studied the relationship between two procurement 
sources and two criteria: (1) pass-fail, and (2) pre-solo training grades. The two pro- 
Curement sources were Aviation Officer Candidates (civilians) and Officer under In- 


struction (commissioned officers). Significant differences were obtained with both 


criteria, With greater failures and lower training grades for the officer group. {Ref. 10 : 
p. 3] 

In summary, biographical information appears to show promise in predict- 
ing pilot training success. Variables showing relationships with training criteria are ac- 
ademic grades and the procurement source. In the Korean Air Force, many academic 
courses are taught in the pre-flight training program. The Korean Air Force has two 
different sources of pilot candidates: the Air Force Academy and ROTC. If such bi- 
ographical information (academic grades and procument sources) were included as the 
predictors for the excellent pilot model, they would improve the prediction of pilot 
training success. 

c. Personality Factors 

The assessment of personality factors using paper-and-pencil tests has a 
long history. Many personality test devices are used in pilot selection programs. In 
particular, the Minnesota Multiphasic Personality Inventory (MMPI), the California 
Psychological Inventory (CPI), and Cattell’s Sixteen Personality Factors are wsermieeen 
selecting pilots. [Ref. 12 : pp. 7-9] As mentioned in chapter II, Fleischman et al., ex- 
anuned the relationship of personality scales to success in aviation training and proved 
that certain personality variables contribute significantly to the multiple prediction of 
the criteria of success and failure. 

The importance of pilot personality can be understood by examining the 
Israeli Air Force (IAF) pilot selection policy. The candidate’s personality plays a sig- 
nificant role in their pilot selection and evaluation. This emphasis is borne out by the 
composition of the initial rating base for the selection of pilot candidates. Table 5 gives 


the initial evaluation rating base. 


Table 5. ISRAELI AIR FORCE (IAF) INITIAL EVALUATION RATING BASE 


nates prt 


Source: Younggling. W. E. et al., “Feasibility Study to Predict Combat Effectiveness 
for Selection Military Roles,” p. $1, McDonnell Douglas. April 1977. 
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Following this initial evaluation, recruits are sent to a 10-day selection and screening 
camp with a new group of behavioral scientists and instructor pilots to assess the can- 
didates’ motivation, ability to innovate, aggressive traits, leadership, and other traits as 
observed through their activities. The IAF takes every necessary step in assuring that 
the best people are selected. In essence, the IAF believes that a pilot’s personality may 
be more important than his individual flying skills. [Ref. 12: p. 3-81] 

Some personality factors seem to show promise for predicting success in 
pilot training. However, there is a weakness in personality testing. The problem with 
utilizing such personality devices and projective tests is their reliance on the individuals 
to provide honest and objective self evaluations, even though such evaluation has the 
potential to prohibit the individual's entrv or continuation in aviator training. This can 
lead to the phenomenon of “faking the test” or test response bias. This can occur as a 
direct result of the subject’s ability to select the best item response that is most socially 
acceptable [Ref. 3: p. 18]. Therefore. a student’s personality evaluation by a flight in- 
structor will be more reliable rather than self-evaluation personality test scores. There- 
fore, the use of the instructors’ personality rating would increase predictability in the 
excellent pilot model. 

ad. Nlotivation Factors 

One of the fundamental requirements for success in flight training 1s a pos- 
itive attitude towards flying, especially if the student aims to make it his profession. Thuis 
attitude should stem from a sound motivation which in turn should stem from a proper 
[areness of the professions requirements. [Ref. 13: p. 33] 

One of the major theories of motivation was developed by psychologist 
Abraham Maslow. It is called the need hierarchy theory. According to Maslow, the 
source of motivation is certain needs. He proposed five stages of needs: physiological. 
safety, social, self-esteem, and self-actualization. Maslow’s need hierarchy theory}; was 
employed by Bucy and Burd 6 to prove the relationship between motivation and aviation 


training success. The principle findings were as follows: 


Successful candidates were significantly more optimistic with respect to all needs 
with the exception of physiological needs. Largest differences appeared with the 
need for self-actualization. Therefore, it appears that expectations with regard to 
need satisfaction might be a valuable predictor of voluntary withdrawal elimination. 
fee! 127 p. 3-55) 


6 Cited by Younggling et al., {[Ref. 12 : p. 3-55] 


It is evident that a highly motivated student pilot’s performance is better 
than that of a poorly motivated one. The rationale is that “a performance is the product 
of motivation and abilitv moderated by situational constraints.” Ability is the student’s 
capability for performing certain tasks. Ability is necessarv but insufficient to ensure a 
best performance. Usually. people perform best when they have the desire to perform 
a task well and also when thev possess sufficient ability. Motivation, therefore, would 


be an important factor in predicting student pilot success in training. 


3. Theoretical Excellent Pilot Model 

The excellent pilot should have good flving aptitude, desirable personality traits, 
sufficient knowledge, and high motivation for his job. The greatest likelihood of 
producing an excellent pilot is through selection based on all of these relevant factors. 
However, in reality, it is impossible to apply all relevant factors (assessed or not as- 
sessed) to pilot selection and the evaluation. It is, therefore, more appropriate to con- 
sider some critical predictors for selection rather than to consider all relevant factors. 

In the “model theoretical specification” above, a varietv of predictors are dis- 
cussed that have proven to be related to criteria of success in pilot training. These pre- 
dictors fall into four distinct domains: flving aptitude, biography, personality. and 


motivation. The formula for the excellent pilot model with these predictors will be: 


Excellent Pilot = f( flying aptitude factors + biographical factors + personality factors 


+ motivational factors ) 


Based on the discussion above and the author’s previous experience as an instructor pi- 
lot, the following variables from the “record of training” seem most likely to apply in the 
theoretical excellent pilot model: 
(1) Flying Aptitude Factors 
e Inherent flving aptitude, 


e Dividing of attention. 


(2) Biographical factors 
e Fhght performance grade, 
e Academic performance grade, 


® Commission source. 


(3; Personality Factors 
e Calmness, 
e Self-confidence, 


© Flexibility. 


(4) Motivational Factor 


e Motivation. 


B. MODEL EMPIRICAL SPECIFICATION 

To empirically estimate the effect of human quality on flight performance, this part 
analyzes qualities of Korean Air Force student pilots. Multiple regression analvsis is 
used to systematically compare the correlation between flight performance and each 
predictor variable. While a correlation coefficient is useful for showing the degree of 
relationship between two variables, it is not useful for predicting one variable from the 
other. Regression analysis, however, does permit prediction of a student pilot’s status 
on one variable (the flight performance score) based on his status on another variable 
(predictor variable) [Ref. 1 : p. 181]. The multiple regression model assumes that the 
dependent variable Y is a linear function of a series of independent variables 


1G ae y,and an error termi. We write the multiple regression as 
Y; = Bh, + fp X>; + f3X3; + so ecccecccee + B,X); + fj (7 = Ile Ue mieisicie 11) (3.1) 


where: 


} = the dependent variable 


X,= the explanatory or independent variable 


€, = the error term associated with the 7 th observation 


B, 


the regression coefficients 


n = the number of the observation 
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In the “model theoretical specification”, eight independent variables are presented. 
The presence of highly intercorrelated independent variables may add little to the pre- 
dictive power of the model. However, these variables will be maintained in the final 
model even if their explanatory power is low because they are considered very important. 
Table 6 gives the independent variable names and their expected relation to flight per- 


formance. 


Table 6. INDEPENDENT VARIABLES AND EXPECTED RELATION 


VARIABLE EXPECTED 
SIGN 


Inherent Flying Aptitude 


Dividing of Attention 
Academic Performances 
Coninussion Source 
Calminess 
Self-confidence 
Flexibility 


Nhotiv ation 





1. The Dependent Variable 
Table 7 shows the dependent variable’s code name and the value coding in the 


SAS program. 


Table 7. DEPENDENT VARIABLE 


Ve Bee VALU EGODING 


Flight Performance ‘ Continuous 





The total flight performance score is used as a dependent variable in the mul- 
tiple regression model. Table 8 gives the flight performance weighting base currently 
used in the Korean Air Force Air Training Command. The flight performance score 
consists of the sum of several checkride grades (70 percent) and each flight grade (30 
percent). The flight instructor evaluates a student’s flight performance and grades his 
performance according to the grading policy. The checkride 1s not conducted by the 
instructor responsible for teaching a pilot, but by an impartial “check” instructor. As 
indicated in Table &, the maximum possible total score is 650. The flight performance 


of sample students ranged from 439 to 574, with a mean value of 514.6. 


Table 8. FLIGHT PERFORMANCE WEIGHTING 


CHECK NON-CHECK 


Source: “Third-Training Wing Manual 60-37: Evaluation of the Student Pilot,” p. 3, 
Seoul, 1980. 



















2. The Independent Variables 
This section defines independent variables and discusses the hvpothesized re- 
lationship between flight performance and predictor variables. 
a. Flying Aptitude Variables 
Table 9 shows the flving aptitude variables’ code name and the value coding 
in the SAS program. 


Table 9. FLYING APTITUDE VARIABLES 


VARTAB Er VALUE COURS 


Inherent Flying Aptitude Continuous 


D (poor aptitude) 
C (fair aptitude) 
B 
A 


ood aptitude) 
xcellent aptitude) 


= 
—_ 
e 


Dividing of Attention Continuous 


ood division) 
xcellent division) 





(1) Inherent Flying Aptitude. Flving requires a certain sense to process 
information. The Korean Air Force pilots call this inherenr flying aptitude (1.e..the abihty 
to grasp numerous perceptions simultaneously and to convert them into immediate and 
precise reactions). The izherenr flying aptitude can be explained by examining the fol- 
lowing inborn elements: 

¢ multilimb coordination--performance of simultaneous tasks with hands or feet, 
® spatial orientation--judgment of position in three dimensional space, 
® response orientation--rapid response to changing stimulus conditions, and 


¢ rate of control--responses in anticipation of velocity of rate change. [Ref. 3: p. 20] 


Inherent flying aptitude can only be judged objectively bv a pilot's 
behavior, actions, and responses, and not by his perceptions and knowledge. Generally, 
there is a sequence in flight training. The sequence is the “imitation of maneuver stage, 
the “intellectual control over the aircraft stage”, and finally the “automatic control 
stage”. Inherent flying aptitude is usually judged by the instructor in the first stage of 


training (When new exercises are being practiced). In this stage. a spatial sense, direc- 


to 
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tional sense. and multilimb coordination are required by the student to imitate his in- 
structor. 

Most instructors agree that inherent flying aptitude is a fundamental 
and critical factor for a pilot. Therefore, this inheren: flying aputude should be used as 
a predictor variable in the selection process. It is hypothesized that the correlation be- 
tween the flight performance and a pilot’s inherent flying aptitude will be highly positive 
and significant. 

Table 10 gives the inherent flying aptitude grade distnbution and 
grading criteria. The instructors evaluated their students’ inherent flying aptitude 
throughout the flight training program. According to the grading criteria, the inherent 
flying aptitude variable was measured bv how completely a student met the requirement 
of a maneuver after the instructor’s demonstration. Onlv 26.9 percent of the students 
performed the maneuver quite Well with minimal advice from the instructor. On the 
lower end of the grade scale, 10.3 percent of the students failed to perform the maneuver 


despite several demonstrations by the instructor. 


Table 10. FLYING APTITUDE GRADING CRITERIA AND DISTRIBUTION 


FRE- 
GRADE QUENCY PERCENT CRITERIA 


A student completely mieets the require- 
ment of a maneuver without anv deviation 
after the instructor's demonstration. 


A student meets the requirement of a par- 
licidar maneuver with minor deviation. 


A student failed to mect the requirement 
despite several demonstrations and cor- 
rections by the instructor. 


A 
A student meets the requirement of a par- 
C ticidar maneuver with a lot of advice and 
corrections by the instructor. 
TOTAL 





(2) Dividing of Attention. The technology of today’s high performance 
aircraft demands a pilot’s rapid and accurate instrument comprehension ability. For 
example. to properly control an aircraft in the instrument flight, the pilot should be able 


to read at least four instruments simultaneously. These instruments provide attitude, 


altitude. air speed, and heading information. In addition, this information is dynamic 
both qualitatively and quantitatively. It changes constantly and the rate of change may 
not be standard between the different instruments’ information. Therefore, a pilot 
should be able to mentally process the total information made up of continually chang- 
ing specific bits of information. Dividing of attention involves several abilities: 

e ability to judge perceptions quickly and accurately, 

e ability to distribute and shift attention, 


e alertness of response, and 


¢ good simulation ability and memory. [Ref. 12: p. 3-66] 


In flight training, dividing of attention 1s considered one of the most 
essential factors in pilots. Table 1] gives the dividing of attention grade distribution and 
grading criteria. The dividing of attention variable was measured by a student's cross- 
check ability and his information processing ability. Only 21.1] percent of the students 
divided their attention properly and processed total information. On the lower end of 
the grade scale. 31.4 percent of students overconcentrated their attention on a single in- 
strument. Consequently. these students caused flight errors because they lacked infor- 


mation processing ability. 


Table 11. DIVIDING OF ATTENTION GRADING CRITERIA AND DISTRIB- 
UTION 


euency (2 see CRITERIA 


A student divides his attention properly 
and processes total information without 
fixing his attention on a Single instrument. 


A student does not fix his attention on a 
single instrument but does take some time 
to process the total information. 


A student needs advice to prevent fixing 
his attention on a single instrument. 


A student overconcentrates his attention 
on a Single instrument and does not proc- 
ess the total information despite a lot of 
advice. 
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b. Biographical Variables 
Table 12 shows the biographical variables’ code names and the value coding 


in the SAS program. 


Table 12. BIOGRAPHICAL VARIABLES 


VARIABLE Verve CODING 


Academic Performance Continuous 


Commission Source j Dummy 


O= Air Force Academy cadets 
I= ROTC officers 





(1) Academic Performance. Table 13 gives the academic courses and 
their weighting base. An academic performance is determined by the total of pre-flight 
examination scores, which is used as a continuous variable in the regression model of 
this study. The maximum possible score is 400. The academic performance of the sample 
students ranged from 337 to 383 and the mean value was 374. Some studies have alreadv 
proved positive relationships between pre-flight academic grades and training criteria. 
Thus, this academic performance variable is expected to have a positive relationship with 


the dependent variable. 


(2) Commission Source. The commission source 1s not a continuous 
variable but a dummy variable. The sample is divided into two subsets: one is the 
KAFA cadet group, and the other is the ROTC officer group. The cadet group is coded 
as 0, and the ROTC officer group is coded as | for the regression analysis. The flight 
performance of the cadet group is expected to be higher than that of the ROTC officer 


group. 


Table 13. ACADEMIC COURSES AND WEIGHTING 


a a 


Source: “Third-Training Wing Manual 60-37: Evaluation of the Student Pilot.” p. 10. 
Scouls 1950: 






















The rationale for the difference between these two groups is that KAFA cadets are self- 
screened individuals who have already shown their motivation to become pilots. Ihe 
sample size of the ROTC officer group 1s relatively smaller than the KAFA cadets group. 
Therefore, the commission source variable may be insignificant due to the small relative 


size of the ROTC officer group. 


c. Personality Vartables 
The list of personality variables 1s presented in Table 14. All variables are 
continuous. Each student was observed during flight training and his personality was 


rated by the instructor. 


Table 14. PERSONALITY VARIABLES 


VARIABLE VALUE CODING 


Calmness ! Continuous 


1= D (mix-up) 

2=C (visibly shakened) 
3 = B (slightly shakened) 
4= A (remain calm) 


Self-Confidence ~ Continuous 


D (no confidence) 
C (low confidence) 
B (some confidence) 
A (full confidence) 


yi 
3 
SI 


Ries ionit Continuous 


(no flexibility) 
(low flexibility) 
(some flexibility) 
(great flexibility) 


Sf. tho 
Lo Te, 
PRBAYD 





(]), Calmness. Calmness is considered a Verv important pilot character- 
istic because pilots often encounter unexpected bad flving conditions. The calmness 
trait required by a pilot is the ability to stabilize and to control his emotion despite un- 
expected disturbances. If the student’s mood is generally shakened and his attention 1s 
stressed additionally by multiple tasks, a small aberration alone could result in consid- 
erable pilot confusion. This confusion leads to the blocking of normal receptivity to 
information when reading or interpreting instruments or listening to radio communi- 
cations. When this happens, the student overconcentrates on a single instrument instead 
of making a proper cross-check. Consequently, his entire perceptual organization breaks 


fon. {Ref 13: pp. 34-35] 


RB 


Physical symptoms of being “shaken” can be observed in the student 
when he is manipulating the controls. Not only does intellectual efficiency deteriorate, 
but “shakiness” also hampers a pilot’s physical movements. Symptoms range from 
“freezing on the controls” to the complete disorder of sensoryvmotor skill. “Freezing” is 
evident in all forms of control handling; hand-control movements, tensing of muscles, 
loss of feel for controls, bad or false trimming and overcorrections during maneuvers. 
For example, a worst case example of being “shakened” in flying is a confusion of con- 
trol movements to the extent that a student pilot cannot control the aircraft during vis- 
ual or instrument flight. A student pilot is particularly susceptible to this experience 
during recoveries from unusual attitudes7?. Extreme sensory disorder is reached when a 
student no longer knows what he 1s doing. [Ref. 13 : pp. 35-36] 

Table 15 gives the ca/mimess grading criteria and grade distribution. 
According to the grading criteria, the ca/mmess variable was measured how well a student 
coped with unexpected situations. The calmness variable is expected to have a positive 
relationship with flight performance. Onlv 37.7 percent of students were remained calm 
despite an unexpected change of situations. On the lower end of the grade scale, 13.7 
percent of the students were very much shakened by an unexpected change of situations 
and could not perform the follow-on procedure. The calmness of a pilot mught be related 
to flying safety. Sometimes aircraft accidents occur due to pilot error. A confused pilot 
may not follow emergency procedures properly, for instance. Usually) a studeiime 


calmness can be identified during his first solo flight. 


(2, Self-confidence.  Self-confidence is defined as “a belief in one’s own 
abilities.” Any student who performed the maneuver or procedure without hesitation 
can be described as having self-confidence. Anxiety about flying and the associated fear 
of having an accident play an insignificant role because, as a rule, students have em- 
barked on flight training voluntarily. However, throughout training the student displays 
numerous feelings of anxiety for other reasons and these may severely handicap the 
display of his capacity or even ruin it. Among the reasons for pilot anxiety is the fear 
of poor grades, the fear that inadequate ability may negatively affect his future career, 
or the fear, due to various reasons, of his instructor. In addition, hidden and subcon- 
scious fears, often lead to a lack of efficiency, the deeper causes of which are not always 


Immediately eutdentalehel 3s poms...) 


7 Anything other than straight and level flight 
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Table 15. CALMNESS GRADING CRITERIA AND DISTRIBUTION 


FRE- 
GRADE QUENCY PERCENT CRITERIA 
ee ee A student remains calm despite an unex- 
ae pected change of Situations. 


A student is Slightly shakend by an unex- 
pected change of situations but inume- 
diately stabilizes and _ performs the 
procedure. 


























A student is visibly shakened by an unex- 
pected change of situations and needs ad- 
vice to perform the procedure. 








A student is very much shakened by an 
unexpected change of situations aud can- 
nol perform the procedure. 


In addition to this, flight errors are increased by insufficient confidence in his own abil- 


itv, in the flight instructor or his wav of teaching. or in the aircraft. Low self-confidence 
1s Most evident in cases Where the student’s attitude is characterized by suspicion of the 
instructor, distrust of the flight equipment, or lack of confidence in his own capability. 
Students who are low in self-confidence are less likely to pass a checkride and such a 
failure could further undermine their self-confidence and thus result in a loss of effi- 
ciency. Once this downhill process has started the student is unlikely to be able to resist 
Peer 13° pp. 37-35] 

Table 16 gives the self-confidence grading distribution and criteria. 
According to the grading criteria, the self-confidence variable was measured by how 
confidently a student performed the maneuver and corrected a deviation. Only 27.4 
percent of the students performed the maneuver and corrected a deviation with full 
confidence. However, 24.0 percent of the students performed the maneuver with hesi- 
tation and did not show any confidence in handling aircraft. The self-confidence variable 
is expected to have a positive relationship with flight performance. It is important to 
note that overconfidence is sometimes the main reason unsafe maneuvers occur which 


Can result in aircraft accidents. 


Table 16. CONFIDENCE GRADING CRITERIA AND DISTRIBUTION 


FRE- ' 
GRADE QUENCY PERCENT CRITERIA 
7 4 A student performs the maneuver without 
~ hesitation and has a full self-confidence. 


student performs the maneuver with 
some self-confidence and needs advice for 
correction. 














A student performs the maneuver with low 
self-confidence and needs a lot of advice 
for correction. 









A student performs the maneuver with 
hesitation and does not have any self- 
confidence. 


(3; Flexibility. Flexibility is characterized by a ready capabihty to adapt 


to new, different, or changing requirements. Flexibility, which in the Korean Air Force 
pilot’s usage is the process by which the pilot compensates for changes of his task. has 
long been recognized as an important attribute of pilot behavior. A pilot must be able 
to cope with unexpected change in the control behavior or his flight plan during flight. 
The need for rapid adaptation by pilots is essential because of capabilities and tactics 
of modern high performance aircraft. Usually, this flexibility can be observed at the 
stage of intellectual control over the aircraft or at the stage of automatic control stage 
in flight training. 

Table 17 gives the flexibility grading distribution and criteria. Ac- 
cording to the grading criteria, the flexibility variable was measured by how flexible a 
student was in coping with an abnormal situation. In the author’s experience, the 
Korean ROTC officers had greater flexibility in ground and flying situations than the 
KAFA cadets. Only 18.9 percent of the students performed the procedure appropriately 
according to the situation. However, 28 percent of students never performed the pro- 
cedure according to the situation. Flexibility is hypothesized to be positively correlated 


with flight performance scores. 


36 


Table 17. FLEXIBILITY GRADING CRITERIA AND DISTRIBUTION 


GRADE eo PERCENT CRITERIA 
189 A student performs the procedure appro- 


priately according to the situation. 


















A student performs the procedure accord- 
ing to the situation but takes some time. 






A student does not perform the procedure 
appropriately according to the situation. 






A student never performed the procedure 
according to the situation. 


d. Motivation Variable 


Table 18 gives the motivation variable’s code name and the value coding 


in the SAS program. 
Table 18. MOTIVATION VARIABLE 


VARIABLE WADGE 26@DING 


Motivation N Continuous 


D (no motivation) 
C (low motivation) 
B (some motivation) 
A (high motivation) 


— 
— 
= 
— 
—_— 
— 
— 
= 


| 
2 
S 
4 





(l) Motivation. One of the fundamental requirements for success in 
flight training is a positive attitude towards flying. The enthusiasm of students who tend 
to be romantically-nunded seldom results in a proper performance of flying tasks. A 


great deal of enthusiasm and love of flying 1s required for success in flight training. 


on 


Motivation 1s indispensible for developing a genuine desire to learn. for mastering the 
more difficult aspects of the flving task, for resistance to physical and psychological 
stress during flight. [Ref. 13: pp. 33-34] 

Motivation 1s evidenced by the progress the student makes during each 
flight. .\fotivation can be expressed by flving attitudes such as zeal for flving. persever- 
ance, strong will, reaction to stress, positiveness, or desire to achieve. Anv student who 
has high motivation for flight would not allow even a small deviation when he performs 
the tasks. This mozivation for flight especially required in instrument flight because in- 
strument flight demands great concentration and perseverance from the pilot. Therefore, 
it 1s hypothesized that the correlation between the mozsivation variable and flight per- 
formance scores Would be statistically significant and positive. 

Table 19 gives the svotivation grading distribution and criteria. Ac- 
cording to the grading criteria, the motivation variable was measured by how positive a 
student was to correct a deviation in performance. Only 29.1 percent of the studemm 
had a strong positiveness to correct even a small deviation. On the lower end of the 
grade scale, 12.0 percent of the students did not have positiveness to correct even a large 


deviation. 


Table 19. MOTIVATION GRADING CRITERIA AND DISTRIBUTION 


FRE- IT 
GRADE QUENCY PERCENT CRITERIA 
eee ee 








student has a Strong poSitiveness to 


2) 
correct ever a small deviation. 










A student has some poSitiveness to correct 
a deviation. 








A student has low poSitiveness to correct 


8 | 8 
Cc 54 oe 
even a large deviation. 
>] 12.0 A student does not have positiveness to 
ig a correct even a large deviation. 


ToTaL | 75 too 
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IV. EMPIRICAL ESTIMATION 


A. DATA REVIEW 

The theoretical excellent pilot model in the previous chapter concluded that pilots 
should have good flving aptitude, desirable personality traits, sufficient knowledge, and 
high motivation. The best way to analyze the characteristics of an excellent pilot 1s 
through the observational data of his activitv. However, time, economic, and spatial 
constraints preclude the gathering of such data in many cases, and necessitate the studv 
of some surrogate activity. Accordingly, it would be preferable to use a score of several 
psychological tests for analysis and generation of an excellent pilot model. However, 
such psychological tests do not exist in the Korean Air Force. As a surrogate, this study 
used “record of training.” 

This “record of training” is one of the student pilot evaluation forms currently used 
in the Korean Air Force pilot training program. The purpose of this form is to provide 
information for the Individual Pilot Quality Control (IPQC) and the development of the 
pilot training program. The form is divided into four basic parts. The first part is con- 
cerned with personal data such as: 

Pmeleiic Inv clitory, 
e Mulitarv history. and 


e Academic history. 


The second part is concerned with pilot’s flight characteristics such as: 
e Flying aptitude, 
e Flying skill, 
e Flving attitude, and 


e Recommended instruction. 


The third part is concerned with grades for sub-tasks such as: 
e Landing, 
e Basic airwork, 
e Instrument flight, 
e Formation flight, and 


e Navigation flight. 
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The fourth part is concerned with physical fitness such as: 
e Sit-ups, 
e Push-ups, 
¢ Pull-ups, and 


e 2km run. 


This form is filled out by the instructor after the student has completed the flight 
training program. Because an instructor is in the unique position of observing a stu- 
dent’s initial reactions to flight, as well as the progress he makes, this single instructor’s 
rating 1s considered credible. 

The rating scale in Table 20 is used to evaluate the student based on each maneuver 
attempted during overall sorties or observed during the supervised solo mission. Student 
pilots are rated on a number of traits or flight characteristics. The instructors judges 
“how much” of each factor the student pilot has. Performance is judged on a 4-point 


scale. Examples of graphic rating scale is shown in Table 20. 


Table 20. RATING SCALE FOR VARIOUS PERFORMANCE DIMENSIONS 


GRADE CRITERIA 


Constantly exceeds task reguirement. 


Frequently exceeds task requirement. 


Frequently: below task requirement. 





Constantly below task requirement. 


The data used in this study are the “records of training” of 175 students who com- 
pleted the Korean Air Force undergraduate pilot training program. There are 14] 
Korean Air Force Academy cadets and 34 ROTC officers. But the use of these data for 
this analvsis poses some problems because there are no observations of the student pi- 
lots who were dropped from the flight training program. The sample may not be rep- 
resentative of the human quality of all the candidate pilots. If students who were 
differentiated due to flight failure are included, the relation between flight performance 
and human quality may be more clear. Another problem is the sample size of the ROTC 


group, which 1s relatively smaller than the KAFA cadets group. 
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B. THE REGRESSION ANALYSIS 


1. Interpretation of Coefficients 
a. Regression Coefficients 
The coefficient shows the effect the independent variables have on the de- 


pendent variable. 
¥;= By + ByXay + B3X3;.---By Ny; + &; (4.1) 


The coefficient 8, measures the change in Y associated with a unit change in J, on the 
assumption that all other values for the remaining explanatory variables are held con- 
stant. Likewise. the coefficient £, measures the change in Y associated with a unit 
change in X, In both cases the assumption that the values of the remaining explanatory 
variables are constant is crucial to our interpretation of the coefficients. [Ref. 14: p. 77] 
b. Beta Coefficients 

Beta coefficients are occasionally used to make statements about the rela- 
tive importance of the independent variables in a multiple regression model. To deter- 
mine beta coefficients, one simply performs a linear regression in which each variable is 
normalized by subtracting its mean and dividing by its estimated standard deviation. 
The beta coefficients bear a close relationship to the estimated coefficients of the original 


unnormalized multiple regression model: 


Ne A Sy, 
Bb; = 2B uae aecck (4.2) 


Y, 
Sy 
In other words. the beta coefficient adjusts the estimated slope parameter by the ratio 
of the standard deviation of the independent variable to the standard deviation of the 
dependent variable. A beta coefficient of .7 can be interpreted to mean that a | standard 
deviation change in the independent variable will lead to a .7 standard deviation change 
in the dependent variable. [Ref. 14: p. 90] 
¢. Correlation Coefficients 
A statistical procedure useful in determining the relationship between a de- 
pendent variable and an independent variable is called the correlation coefficient. A 
correlation coefficient reflects the degree of linear relationship between two variables, 
which we shall refer to as \ and Y. The symbol for a correlation is r, and its range is 


from -1.00 to +1.00. A correlation coefficient tells two things about the relationship 


4] 


between two variables: one is the direction of the relationship and the other is the mag- 
nitude. The direction of the relationship is either positive or negative. A positive re- 
lationship means that as one variable increases in magnitude, so does the other. The 
magnitude of the correlation is an index of the strength of relationship. Large corre- 
lations indicate greater strength than small correlations. The stronger the correlation 
between two variables (either positive or negative), the more accurately we can predict 


one variable from the other. (Ref. 1 : pp. 55-61] 


2. Hypothesis Test 

(1) The T-test. The T-test is used to test whether an estimated slope 
coefficient is significantly different from a hypothesized value (f =0). The level of sig- 
nificance indicates the probabilitv of observing an estimated t-value greater than the 
critical t-value if the null hypothesis (8 = 0) were correct. Therefore, the result can be 
explained by saving that a coefficient has been shown to be ” statistically significantly 
positive.” or just “statistically significant” at the 10 percent level of significance or 90 
percent level of confidence. The Prob> Jt} 1s the probabilitv that a t statistic would ob- 
tain a greater absolute value than observed, given that the true parameter 1s zero. {Ref. 
capi o-75 


3. The Results of the Multiple Regression Model 


Table 21 shows the mean and standard deviation of each variable. 


Table 21. THE MEAN AND STANDARD DEVIATION OF EACH VARIABLE 


VARIABLE NIEAN STANDARD DEVIATION 


514.5545 Wages o eI 
2.7542 ON2GG] 
2.3059 1.1278 


2.7428 1.0098 
2.5600 1.0836 
2.8514 Og is 
2.6057 ere 
366.0485 10.1780 





The results of the multiple regression model are described in Table 22. The table shows 


linear coefficients (regression and beta) from the Ordinary Least Squares (OLS) method. 


Table 22. RESULTS OF THE REGRESSION MODEL 


Variables Coefficient Prob> |t| Beta Coefficient 


Intercept 516.887 
(56.286) 

APT 

MOT 

TDG 

ue 

CAGE 

CON 

er. 


SOU 


6 agen le fo) 
R-SQUARE : 0.4934 
ADJUSTED R-SQUARE : 0.4690 


( ): Standard Error 


; Significant at 0.05 level 
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Table 23 shows the correlation coefficient matrix. 


Table 23. PEARSON CORRELATION COEFFICIENTS 


1.00 -O.11 0.63 


100 = -0.02 
1.00 





In the multiple regression model, five of the eight variables were significant at 
the 0.05 level. They were the inherent flying aptitude, motivation, calmness, dividing of 
attention and flexibility variables. All the significant variables had expected signs except 
the flexibility variable. Of the other variables, self-confidence and academic performance 
did not have the expected sign. This may be due to specification errors in the variables 
that are included or excluded from the model. an incorrect mathematical form of the 
model, or high multicollinearitv between two variables. 

In fact, there is no universally accepted test of multicollinearitv. Instead, most 
researchers develop a general feeling for the severity and importance of multicollinearity 
in an equation by looking at a number of the characteristics of the estimated equation. 
One of the first indications of the possible presence of severe multicollinearity is the 


combination of a high R-square with low calculated t values for the individual regression 
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coefficients. However, all of the explanatory variables had a greater absolute t value 


than 1. Therefore, multicollinearity 1s not expected. [Ref. 14: pp. 189-191] 


a. Aptitude Variables 
As expected, two aptitude variables (inherent flying aptitude and dividing of attention) 
Were significant at the 0.05 level. 

(1) Inherent Flying Aptitude. The regression coefficient was significant 
at the 0.01 level in the model. The correlation coefficient of the ‘nherent flying aptitude 
was 0.63. The 40 percent of flight performance variance can be explained by this inher- 
ent flying aptitude variable. This variable had the highest correlation among the eight 
predictors. The inherent flying aptitude variable was found to be the primary factor 
among all of the predictor variables in predicting flight performance. Thus, a student 
who has a good inherent flying aptitude will have a better flight performance than those 
who have other good characteristics. A student’s inherent flying aptitude should be 
evaluated carefully and be applied to predict student success in flight training. 

(2} Dividing of Attention. As expected, the regression coefficient was 
Statistically significant at the 0.01 level and had a positive correlation with flight per- 
formance. The correlation coefficient was 0.48. As discussed earlier, high aircraft speed 
and complex cockpit instrumentation require rapid information processing by the pilot. 
Thus, the multiple regression analvsis suggests that the dividing of attention ability 1s a 


fundamental element of a pilot. 


b. Biographical Variables 

Neither of the two variables (commission source and academic performance) 
proved significant in the models. 

(lj) Academic Performance. The result of the academic performance 
variable did not agree with the hypothesized relationship and was not statisticallv sig- 
nificant. Therefore, no conclusion could be drawn about the relationship between flight 
performance and academic performance. 

(2) Conpnission Source. The commission source variable also had a very 
weak correlation with the dependent variable. The correlation coefficient was -0.11. The 
difference in individual quality of the two subsets (the ROTC officer group and the 
KAFA cadet group) in flight performance was insignificant. One possible reason 1s the 
small sample size of the ROTC group. As indicated in Table 24, the cadet group dem- 


onstrated better performance in most of the quality gradings such as flight performance, 
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dividing of attention, self-confidence, motivation and academic performance. A possible 
reason for this 1s that the cadet group may be more motivated than the ROTC group. 
But the ROTC group showed a higher mean grade in calmness and flexibility. The 
reason nught be because the ROTC group students were already commussioned as offi- 


cers and therefore had more social experience. 


Table 24. MEAN GRADES AND STANDARD DEVIATIONS FOR ROTC AND 
KAFA STUDENTS 


ROTC KAFA 


VARIABLE 
ST/DE MEAN ST/DE 
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c. Personality Variables 
Two of the three personality variables were significant at the 0.05 level. But 


the result of two variables did not agree with the hypothesized relationship. 


(1, Calmness. The calmness variable was expected to have a positive 
relationship with flight performance and its result conformed with the hypothesized re- 
lationship. The regression coefficient was significant at the 0.05 level and the correlation 
coefficient between calmness and flight performance was 0.50. This personality trait 1s 
essential in handling an unexpected situation or emergency. It is possible that a lack of 
this calmness trait is highly related to aircraft accident due to pilot error. Thus, 1n- 
structors should observe the calmness of students verv carefully and applv this observa- 


tion in pass or fail decision making. 
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(2, Self-confidence. The result of the self-confidence variable did not 


agree with the hypothesized relationship and was not statistically significant. Therefore, 
no conclusion could be drawn about the relationship between flight performance and 


self-confidence. 


(3) Flexibility. Unexpectedly, the flexibility variable was statistically 
significant and negatively related to flight performance scores. The negative sign of the 
regression coefficient means that the more flexible the student is, the less his flight per- 
formance score 1s. As mentioned in the previous chapter, flexibility 1s required at the 
“intellectual control over the aircraft stage” or at the “automatic control stage” in flight 
training rather than at the imitation maneuver stage. However, some students’ flying 
ability remained in the “imitation maneuver stage”. Therefore, it 1s suspected that in- 
structor pilots had some difficulty measuring the students’ flexibility trait in those situ- 


ations. 


ad. Nlotivation Variable 
‘]) Motivation. The regression coefficient of the motivation variable was 
significant at the 0.01 level and had a strong positive relationship with flighi performance. 
The correlation coefficient between motivation and flight performance was 0.54. The 
flight performance score was very sensitive to levels of morivation. In conclusion, student 
pilot’s motivation 1s considered one of the most important factors in predicting student 


pilot success in flight training. 


4. Summary of the Regression Analysis 

Table 25 presents a summary of the regression analvsis for the multiple re- 
gression model. As indicated. 43.6 percent of the criterion variance could be explained 
by the flving aptitude variables-- inherent flying aptitude and dividing of attention. The 
addition of motivation information (motivation variable) increased the explained variance 
by 1.5 percentage points. After entering the motivation variable, an additional 3.6 per- 
cent criterion variance was explained by personality variables-- flexibility, calmness, and 
self-confidence. Academic performance explained only 0.2 percent of the flight perform- 


ance variance. The final equation yields an R-square of 0.4934. 
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Table 25. SUMMARY OF THE REGRESSION ANALYSIS 


VARIABLE EN- 


0.4040 0.4040 
0.0321 0.4361 


0.0148 0.4509 
GAO ISTS 0.4703 
0.0094 0.4797 
0.0077 0.4874 
0.0022 0.490] 





C. THE VALIDITY OF THE MODEL 
1. Coefficient of Determination 
An estimated regression equation should be capable of explaining the sample 
observations of the dependent variable Y with some degree of accuracy. That 1s. the 
better the fit of the equation, the closer the estimated Y will be to the actual y. The 
coefficient of determination (R-square) is the ratio of the explained sum of squares to the 


total sum of squares: 


a 
t 

I 

| 
— 
— 
ues 
LP) 
~~ 


Wihiere 
TSS Total Sum of Squares 
Ess Explained Sum of Squares 
RSS Residual Sum of Squares 


The higher the R-square, the closer the estimated regression equation fits the sample 
data; measures of this tvpe are called “goodness of fit” measures. R-square must he in 


the interval 


0O<R' <1 (4.4) 
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A value of R-square close to 1 shows a “good” overall fit, whereas a value near 0 shows 
a failure of the estimated regression equation to explain the values of Y, better than 
could be explained by the sample mean Y. In other words, R-square can be defined as 
the percentage of the variation of Y around Y that is explained by the regression 
equation. The R-square of the multiple regression model is 0.49. That means 49 percent 
of the total variance can be explained by the excellent pilot model. [Ref. 15: pp. 28-30] 
eer -test 

While the R-square 1s a measure of the overall degree of fit. a shghtly modified 

version, called the F-ratio, is a “statistical test” of the overall degree of fit of the esti- 


mated equation. The F-ratio is defined as: 


ESS|(K) 


It is the ratio of the explained to the unexplained portion of the total sum of the 
squares, adjusted for the number of independent variables (K) and the number of ob- 
servations in the sample (n). When the value of F is high, the estimated regression 
provides an adequate statistical explanation of the deviations of Y, from Y. The overall 
fit of the equation is considered statistically acceptable only if the computed value of the 


F-ratio is greater than a “critical value” found in the table of F-values. 
hy ole) eal aa 
igus VdgmeeOl [vue 


The computed F-value of the excellenr pilor model is 20.08. The critical F-value 
for a 1 percent level of significance is 2.51. A computed F-value greater than 2.51 would 
reject the null hvpothesis and declare that the equation is statistically significant at a 99 


mowecnueveroconiidence. [Ref. 15: p. 30} 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

The importance of careful pilot selection in the Korean Air Force has become par- 
amount with the “roll out” of the extremely expensive and complex F-16 Fighting 
Falcon. In addition, constant aircraft aecidents due to pilot error emphasize the im- 
portance of careful selection even more. While in other countries psychological testing 
is emphasized in pilot selection. the Korean Air Force has shown less concern about 
pilot selection research. In the Korean Air Force pilot selection, psychological assess- 
ments are made during the initial aptitude checkride. However. these aptitude tests lack 
standardized criteria. The argument in favor of this tvpe of assessment is that an in- 
structor can distinguish a student’s ability by virtue of his own experience. In essence, 
the Korean Air Force needs a reliable selection device to improve predictor validity. 

This study has specified an excellen: pilot model for the Korean Air Force pilot se- 
lection program. Several human qualities have been analyzed and their relationships 
with flight performance have been identified. For this analysis. “record of training” of 
the undergraduate pilot training was used. The total flight performance score was Sse- 
lected as a dependent variable and eight human qualities were selected as independent 
variables based on previous findings. The resulting excellent pilot. model answered the 
the research questions posed earlier and recommended a method to improve the validity 
of predictors for the Korean Air Force pilot selection. This excellen: pilot model an- 


swered the questions: 


e What are the primary factors that predict aviation excellence ? and 


e How do these factors apply to student pilot screening in the Korean Air Force ? 


The beta coefficients reflect the relative importance of the predictors. As was shown 
by the results of the regression model (Table 22), the inherent flying aptitude variable 1s 
the most important factor in predicting student pilot success in flight training. Next, a 
strong motivation Variable predicts good flight performance in flight training. Additional 
human qualities such as dividing of attention and calmness are expected to improve 


flight performance. 


The following formula provides the expected flight performance for a specific student: 


Flight performance = 516.887 + 13.407*(APT) + 6.094*(MOT) + 5.195*(ATT) - 
ele (ie Weve 1.525 (CAL) - 3.5547(CONS - 0.164 *( ACA) - 4.107*(SOU) 


The computed flight performance value will be obtained by appropriately weighting a 
student pilot’s qualities such as flying apititude, motivation, personality, commission 
source, and academic performance grade. 

Consider the following example of an instructor actually using the formula. After 
a certain amount of flving, an instructor rates his student’s quality like this: the inherent 
flying aptitude is good (B = 3), motivation 1s good (B = 3). dividing of attention is good 
(B = 3). flexibility is fair (C =2), calmness is fair (B = 2), self-confidence is excellent 
(A = 4). academic performance is 365.1 and he is a KAFA cadet (commission source 
= ()). This student’s flight performance score should be 516.8. This score predicts that 
he will successfully complete the flight training program because his expected score 1s 
above the mean flight performance score. This computed value, obtained bv applving 
this model, will enhance the predictive validities in student pilot screening. 

The anticipated benefit of this study is the improvement in the screening of under- 
graduate pilots in the Korean Air Force. The excellent pilot model, using data from 
undergraduate pilot training programs, should lead to an increasing validity of the 
screening predictors. Also, predictors that are defined in the model could be used to 
improve the pilot training program and Individual Pilot Qualitv Control (IPQC). Im- 
provements in the qualitv of Korean Air Force pilots will result in a decreasing accident 


rate and an increase in air combat readiness. 


B. RECOMMENDATIONS 

Because of the small sample size (175 students), the findings of this study are not 
enough to generate a specific selection policy. Therefore, it 1s recommended that a suf- 
ficient data sample be collected from the Air Force Academy and undergraduate pilot 
training programs. Adequate overlap in time intervals should be allowed to provide for 
maximum record matching. Accurate and confidential instructor ratings should be 
stressed for future study. If these weaknesses can be corrected, future research mav be 
able to improve or refine the detailing policy and create a more effective method of 


predicting student pilot success in the training program. 


3D). 


The author strongly recommends that the Korean Air Force organize a pilot se- 
lection research and development (R&D) team, equipped with necessary selecting de- 
vices, a computer center for research, statistical packages, and personnel with the skills 
necessary to perform that work. Cooperation with the U.S Navy Recruitment Com- 
mand selectors, Naval Aerospace Medical Institute’s (NAMI) flight examiners, and 
NAMI psychologists in getting information may be beneficial. Finally, the purpose of 
this study was essentially to provide insight into the importance of aviation psychology 
in student pilot screening and selection. It 1s hoped that these results will stimulate the 


Korean Air Force to have more concern about its pilot selection process. 
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APPENDIX. SAS PROGRAM 


TITLE1 ‘THESIS’; 
DATA QUALITY; 

INPUT STATE ID 1-3 FLY 5-10 APT 12 CAL 14 

CON 16 MOT 18 FLE 20 ACA 22-26 

ATT 28 SOU 30; 

CARDS: 

PROC REG DATA= QUALITY: 

MObEFLY= APT ATT ACA SOU CAL CON FLE MOT; STB: 
PROC FREQ; 

TABLES CAL CON MOT SOU ATT FLE APT; 

PROC MEANS: 

VARIABLES FLY ACA; 

PROC CORR: 

Pye FLY SOU APT MOT CAL CON FLE ACA ATT. 

PROC STEPWISE: 

MODEL FLY= APT ATT FLE CAL CON SOU ACA MOTI/SLE =.9: 
PROC REG DATA= QUALITY: 

MODEL FLY= APT ATT SOU ACA CAL FLE CON MOT?P ; 
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